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1. INTRODUCTION 

Nowadays, optimization plays an important role in various fields of real-world, e.g. engineering, 
finance, transportation and operational research [1]. There are many kinds of optimization problems. One of 
them is constrained non-linear optimization. An optimization problem is classified as constrained 
optimization if the objective function is minimized or maximized under given constraints [2]. 
Constrained non-linear optimization is defined as a constrained optimization problem where its objective 
function or at least one of the constraints is non-linear function [3]. In real life, constrained optimization 
problem may be found very often because many required resources are not always unlimited. 

Metaheuristics have been widely implemented for solving many kinds of optimization problems, 
including constrained non-linear optimization. In solving optimization problem, metaheuristics search 
solution randomly and by trial and error. They are not like deterministic methods which require initial 
guess [4] and mathematical requirements, e.g. gradient or continuous functions [5]. They only require 
objective function and the searching domain in solving problems [6]. Moreover, they relatively need cheaper 
computation cost than the deterministic ones. 

Since 1960s, metaheuristics have been rapidly developed [6]. Some of the famous metaheuristics are 
Genetic Algorithm (GA), Particle Swarm Optimization (PSO) and Differential Evolution (DE). They have 
been widely implemented in various optimization problems. However, they have a same disadvantage, 
i.e. easy to fall into local optima [7-9] or tend to prematurely converge [9, 10]. As the consequence, 
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they often fail to approach the optimal solution. Therefore, it is necessary to find a metaheuristics that can 
perform better in solving optimization problems. 

In [9], it is stated that the main cause of premature convergence in these well-known algorithms is 
the direct comparison of newly discovered solutions with the current best-known solution. 
Therefore, Gonzales-Fernandez and Chen [9] proposed a novel metaheuristics named Leaders and Followers 
(LaF) which avoids this kind of comparison. In [9], LaF is better in solving unconstrained non-linear 
optimization than PSO and DE. It is able to explore better so that it can perform better in muti-modal 
optimization problems. Moreover, LaF is simple and does not need any parameter, so it may save 
computation time because there is no need to estimate any parameter. However, in [9] there is no any 
discussion about boundary constraint handling, even though there is a possibility that some new solutions 
created by the operator in LaF is outside the searching space. 

There are some methods to deal with the boundary constraint violations. Some of them are re- 
initialization and clamping (bring back the solution to the peak value). In [11], it is proven that clamping 
method is more effective than re-initialization method. It can improve the solution much better than the re- 
initialization method. Therefore, it can be used in LaF to handle the boundary constraint violation. 

For solving constrained optimization problem, a metaheuristic should be modified using a 
constraint-handling technique. There are various constraint-handling techniques. The most widely used 
technique is penalty function [12]. It modifies the objective function by adding a penalty function. 
This technique has been being used with various metaheuristics, both the old and the new ones. In [13], 
Harmony Search (HS) algorithm was modified using death penalty, static penalty and a new penalty function 
technique, named two stage penalty function. In [14], static penalty and feasibility rules method were used 
with Firefly Algorithm (FA) for constrained optimization. In [15], static penalty technique was also 
combined with a novel metaheuristic, named Bacterial-inspired Algorithm, for constrained optimization. 
Static penalty and dynamic penalty function were also used with an emerging metaheuristic, named Cohort 
Intelligence (CI) for constrained optimization [16]. In [17], Differential Search (DS) algorithm is developed 
for constrained optimization with static and dynamic penalty function. 

In this study, LaF is implemented for solving constrained optimization problem using static penalty 
function for handling the constraints and clamping method [11] for handling the boundary constraint 
violation. After being modified, the proposed algorithm was evaluated using several well-known benchmark 
problems. Then, the evaluation results of the proposed algorithm are compared with other metaheuristics 
[13, 14], [16-18]. Section 2 introduces the proposed algorithm. Section 3 is the research method. 
Section 4 presents and discusses the results. Then, the conclusions are given in Section 5. 


2. THE PROPOSED ALGORITHM 

Leaders and Followers (LaF) algorithm uses two different populations, i.e. Leaders and Followers. 
Followers is assigned to explore some new sub-regions of the searching space that have local optima 
(which called attraction basin), whereas Leaders is assigned to store promising solutions which may be a 
global optimum. In this algorithm, there is no comparison of new discovered solutions and a best current 
solution. This kind of comparison is avoided to prevent premature convergence. Algorithm 1 is the 
pseudocode of Leaders and Followers algorithm. 

There is possibility that Trial is formed outside the searching space. To handle the boundary 
constraint violation, this study uses clamping method by bringing the solution to the boundary value [11]. 
The algorithm is modified by adding the conditionals on line 15-16. If the position of Trial is not in the 
searching space, the position is moved to the boundary. To handle the constraints, this algorithm uses penalty 
technique. This technique is the most widely constraint-handling technique. It transforms constrained 
problem into unconstrained problem. The objective function is modified by adding penalty function. 
The general form of penalty function is as follows. 


F(%) = f(®) +) M x max(0, 9(2)] x a +) M x (|h(@|—e) x b 


F(&) is modified objective function, f(X) is original objective function of constrained optimization problem, 
M is penalty factor which should be large enough for minimization problems, g(X) is original inequality 
constraints, h(X) is original equality constraints, a and b are both constants and € is error tolerance. 
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3. RESEARCH METHOD 

The proposed algorithm was evaluated using well-known benchmark problems for constrained 
optimization (f,-f;3). Table 1 is the summary of the benchmark problem where p is the ratio of the feasible 
search space size and the entire search space, LI is the number of linear inequality constraint, NI is the 
number of non-linear inequality constraint, NE is the number of nonlinear equality constraint and a is the 
number of active constraint. Table 2 presents the details of problem. Each optimization problem was 
evaluated in twenty-five independent runs with various population size, n = 10, 25,50, 100. The algorithm 
was stopped if there was no better solution found in 5000 iterations in a row or the algorithm had been run in 
600 seconds. The proposed algorithm uses static penalty factor and parameters, i.e. M = 50,000,a = 1,b = 
1 and ¢ = 0.0001. If the proposed algorithm meets difficulty to reach the optimal solution of a test function, 
the algorithm will be evaluated with a bigger population size and longer computation time limit. 


Algorithm 1. Pseudocode of Leaders and Followers Algorithm 





s = number of decision variables 
n = population size 
lb(j) = lower bound of j-th decision variables 
ub(j) = upper bound of j-th decision variables 
5:L = initialize Leaders with n uniform random vectors 
F = initialize Followers with n uniform random vectors 
repeat 
for i = 1:n do 
indl = round(rand*n) 
indf = round(rand*n) 
leader = L(indl,:) 
follower = F(indf,:) 
for j = 1:s do 
trial(j) = follower(j) + rand*2*(leader(j) — follower(j)) 
if trial(j) < lbG) then trial(j) = lbGj) 
if trialj)) > ub(j) then trial) = ub() 
end for 
if f (trial) < f (follower) then F (indf,:) = trial(:) 
end for 
if median(f (F)) < median(f(L)) then 
Lnew(1) = an element of L or F which has the best fitness 
for i = 2:n do 
leader = pick an element of L randomly 
follower = pick an element of F randomly 
if f (leader) < f (follower) then Lnew(i) = leader 
else Lnew(i) = follower 
end 
: F = reinitialize Followers uniformly 
25: end if 
26: until the termination criterion is satisfied 


Table 1. Summary of the Benchmark Problems 








Test Function Optimal Solution Dimension Type of f p(%) LI NI NE a 
fi -15 13 Quadratic 0.0003 9 0 0 6 
fo -0.8036191 20 Nonlinear 99.9962 O 2 0 1 
fs -1.0005001 10 Polynomial 0.0002 0 0 1 1 
fa -30665.539 5 Quadratic 26.9089 O 6 0 2 
fs 5126.496714 4 Cubic 0.0000 2 0 3 3 
fe -6961.813876 2 Cubic 0.0065, 0 2 0 2 
fr 24.30620907 10 Quadratic 0.0001 3 a] 0 6 
fs -0.09582504 2 Nonlinear 0.8484 0 2 0 0 
fo 680.6300574 Z Polynomial 0.5319 0 4 0 2 

fio 7049.2480205 8 Linear 0.0005 3 3 0 6 
fu 0.7499 2 Quadratic 0.0099 0 0 1 1 
fr -1 3 Quadratic 4.7452 0 1 0 0 
fis 0.053941514 5 Exponential 0.0000 0 0 3 3 





Indonesian J Elec Eng & Comp Sci, Vol. 13, No. 1, January 2019: 162 — 169 


Indonesian J Elec Eng & Comp Sci 


ISSN: 2502-4752 


0 165 





Table 2. Details of the Benchmark Problems 

















Objective Function Constraints Bounds 
Gi (%) = 2x, + 2x. + X19 +X, -—10 <0 
G(X) = 2x, + 2x3 +. X19 $Xy2 —10 <0 L=(0,0 
G3(%) = 2x2 + 2x2 +4, +X. -10<50 0) air 
4 4 13 G(X) = —8x, + X19 <0 U=(11 
fi f@=5) u-8) x2 -) xm gs(&) = 8x +41 <0 NET 
i=1 i=1 i=5 G(X) = —8x3 + X42 50 00 100, 
3 1, 100, 100, 
Q7(X) = —2x%4 —X5 + X19 <0 100. 1) 
Gg(X) = —2xX6 —X7 +X, <0 2 
Go(X) = —2xg —X9 + X42 S 0 
fG@ “ s 
ee Be cos(xi)* — 211 cos (x)? a@=075-[] x, <0 =0: 
2 7 s 
Vv Mins Xx; 92(%) = y x; -7.5s <0 pes 
s=20 i=1 
> = s = s — ” 
fs i es (vs) [os hy(%) = > x? -1=0 ae : 
s= 10 a ae 
g,(2) = 85.334407 + 0.0056858x>x5 
+ 0.0006262x, x, 
— 0.0022053x3x, -92 <0 
go(2) = —85.334407 — 0.0056858x,x5 
— 0.0006262x,x, 
+ 0.0022053x3x5 <0 Peres 
f(@ = 5.3578547x2 +.0.8356891x,x, 922) = 8051249 + 0.0071317x9%5 + 0.0029955xy%2 47 9757) 
+ 0.0021813x3; — 110 <0 
fa + 37.293239x, F U = (102, 45, 
~ 40792141 ga(X%) = —80.51249 — 0.0071317x2x5 45, 45, 45) 
— 0.0029955x,x» — 0.0021813x2 aD 
+90<0 
gs() = 9.300961 + 0.0047026x5x5 + 0.0012547x,x; 
+ 0.0019085x4x, — 25 <0 
g¢(Z) = —9.300961 — 0.0047026x5x5 
— 0.0012547x, x; 
— 0.0019085x,x, + 20 <0 
Gi) = —x,+x3-0.55 <0 
92(%) = —x3+x,-0.55 <0 
h3(#) = 1000 sin(—x3 — 0.25) 
+ 1000 sin(—x,4 — 0.25) + 894.8 L = (0, 0, - 
f (2) = 3x, + 0.000001x3 + 2x, —x,=0 0.55, -0.55) 
fs 0.000002) _, hy (%) = 1000 sin(x3 — 0.25) U = (1200, 
( 3 )x + 1000 sin(x3 — x, — 0.25) 1200, 0.55, 
+ 894.8 —x,=0 0.55) 
hs(X) = 1000 sin(x, — 0.25) 
+ 1000 sin(x, — x3 — 0.25) 
+ 1294.8 =0 
z L = (13, 0) 
em _4nN3 = 5733 g,(X%) = —(x, — 5)? — (x, — 5)? +100 <0 =A 
fe f(%) = (x1 10) ae (x2 20) g2(x) = (x, os 6)? + (xp os 5)? — 82.81 <0 U io 
hey 3 = = gi(%) = -105 + 4x, + 5x. — 3x7 + 9x, <0 
PR) Se bg + me ae ioe G2() = 10x, — Bx, — 17x, + 2xq <0 
- Ae _ 5) 93(%) = —8x, + 2x2 + 5x9 — 2x19 —-12 < 0 
iG. ¢ 32 G(X) = 3(x, — 2)? +4(x, — 3)? + 2x3 — 7x, — 120 
ed <0 
sane = ae 
fr Ey 2(%6 D Gs(X) = 5x? + 8x, + (x3 -6)?-2x, —-40<0 BO) 
+ 5x5 s5 2 2 U=10 
+ 7(x_ — 11)? Go(X%) = xf + 2(x, —2)% — 2xyx2 + 14x53 — 6x6 
< 
+ 2(%5 — 10)? 2 Be im x 2 2 
+ (%9 - 7 G7(X) 0.5(x, — 8)* + 2(x, — 4)* + 3xé — x6 — 30 
<0 
oe ga(%) = —3x, + 6x, + 12(x9 - 8)? — 7x49 < 0 
fo {@=- (sin(2mx,))*sin(27x2) g@) = -xp-x +1 <0 L=0 
x3 (x1 + x2) g2(X) = 1—x, + (x, - 4)’ <0 U=10 
2) _ 2 2 4 
TQ) = Gal Qt ere ee *3 gi(&) = -127 + 2x? + 3x4 + x5 +.4x2 + 5x5 < 0 
f apes x2 4x4 92(X) = —282 + 7x, + 3x, + 10x$ +x4—x5 < 0 L=-10 
? ae = Tbs 7 g3(X) = -196 + 23x, + x3 + 6x2 — 8x, < 0 U=10 
= ax u S Ga(X) = 4x? +x2 — 3x, x, + 2x3 +5x,—-11x, < 0 
fi ff) =x, +x. + x3 gi(%) = -14+ 0.0025(x, + x6) < 0 L = (100, 
92(%) = -1+4+ 0.0025(x, +x, -—x4) < 0 1000, 1000, 
g3(%) = -14+0.01(%, — x5) < 0 10, 10, 10, 
94(%) = —x, X65 + 833.33252x, + 100x, — 83333.333 10, 10) 
<0 U = (10000, 
Gs(%) = —X 2X7 + 1250x, + x2xX4 — 1250x, < 0 10000, 
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Objective Function Constraints Bounds 
G62) = —X3X%_ + 1250000 + x5x, — 2500x, < 0 10000, 1000, 
1000, 1000, 
1000, 1000) 
fi f@) = xi + @ - 1? A(X) = x2 — xf = 0 L=-l 
U=1 
fr f(%) = -(100 — @, — 5)? = (%2- 5)? g ®) =  — p)? + (2 — g)? + (3 — 7)? — 0.0625 < 0 L=0 
— (x3 — 5)*)/100 U=10 
fi f (£) = e%1%2%3%4%s hy) =x? +23 423 +23 +x2-10=0 L=-23 
hy (X%) = xX2x3 — 5x4x5 = 0 U =2.3 


h3(%) = x2 +43 +1=0 





4. RESULTS AND DISCUSSION 

Table 3 and 4 presents the evaluation results with population size (n) = 10, 25, 50 and 100. 
The algorithm obtains the optimal solution for f,, fs, fa, fe, fe, fo. fir and fiz. The standard deviation of all 
obtained solutions for fy, f¢,fg and g12 approaches zero. This means that in all runs, the algorithm 
consistently obtains optimal solutions for these problems. Table | shows that all of these problems 
(fa, fe. fg and f;2) are low dimensional (s < 5) and have no equality constraints. 


Table 3. The Results Obtained by the Proposed Algorithm for f, — fz 








Problem fi he fs in fs fe fr 
Optimal Solution -15 -0.8036 -1.0005 -30666 5126.5 -6961.8 24.3062 
Best “15 -0.8036 -1.0002 -30666 5126.8 -6961.8 24.3558 

= Mean -12.9843 -0.6849 -1.0002 -30666 5264.9 -6961.8 25.4199 

L Worst -10.1094 -0.5702 -1.0002 -30666 5693.3 -6961.8 27.4359 
Std 1.4923 0.0685 2E-06 4E-06 209.63 4.5E-11 0.7485 

Best -15 -0.7881 -1.0002 -30666 5134.0 -6961.8 24.3188 

& & Mean -14.0844 -0.7319 -0.9835 -30666 5239.4 -6961.8 24.7202 
B | Worst -11.8281 -0.6057 -0.8326 -30666 5790.5 -6961.8 26.0405 
a Std 0.9483 0.0452 0.0530 7E-10 198.89 2.3E-12 0.3933 
z Best -15 -0.8036 -1.0003 -30666 5128.6 -6961.8 24.3156 
‘3 Mean -14.4737 -0.7645 -0.9538 -30666 5253.1 -6961.8 24.6504 
6 - Worst -11.2812 -0.5744 -0.7191 -30666 5673.6 -6961.8 25.077 
Std 1.0533 0.0497 0.1006 1E-11 164.81 0 0.2545 

= Best -15 -0.8036 -1.0002 -30666 5126.7 -6961.8 24.3084 
S Mean -15 -0.7897 -0.9521 -30666 5327.2 -6961.8 24.4549 
Worst -15 -0.7692 -0.8074 -30666 5714.9 -6961.8 24.8242 
Std 7.25E-16 0.009 0.0611 6E-12 224.09 0 0.1303 





Std = Standard Deviation 


Table 4. The Results Obtained by the Proposed Algorithm for fg — fi3 

















Problem fs fo fio fi fia fis 
Optimal Solution -0.0958 680.6301 7049.2 0.7499 -1 0.0539 
= Best -0.0958 680.6333 7095.9 0.7499 -1 0.1789 
= Mean -0.0958 680.6518 7897.8 0.7499 -1 1.0785 
= Worst -0.0958 680.6736 10911 = 0.7499 -1 4.9511 
Std 4.01E-18 1.03E-02 868.6 9.3E-8 0 1.5194 
7 -_ Best -0.0958 680.6324 7049.5 0.7499 -1 0.0865 
& “ Mean -0.0958 680.6360 7468.2 0.7499 -1 1.0323 
E = Worst -0.0958 680.6423 8076.3 0.7499 -1 5.0551 
nv Std 4.91E-18 2.80E-03 298.6  6.5E-8 0 1.4771 
3 = Best -0.0958 680.6305 7114.1 0.7499 -1 0.0730 
‘3 ‘ ~=Mean -0.0958 680.6319 7298.3, 0.7502 -1 1.6426 
5 = Worst -0.0958 680.6339 7547.2 0.7529 -1 11.0996 
Std 8.96E-18 1.00E-03 118.2 9.6E-4 0 2.3141 
o Best -0.0958 680.6301 7081.5 0.7499 -1 0.6148 
= Mean -0.0958 680.6307 7239.8 0.7500 -1 0.9625 
i Worst -0.0958 680.6321 7469 = 0.7505 -1 3.1843 
= std 8.96E-18 4.59E-04 111.7 2.0E-4 0 0.7877 





For f, which is a high dimensional problem (s = 13), the obtained errors is quite high when the 
population size (n) = 10, 25 and 50, but when the population size (n) = 100, the errors approaches zero. 
The algorithm successfully obtains the optimal result in each run when the population size (n) = 100, 
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although the number of dimension and inequality constraint in f, is higher than f,, f, and f,5. Table 1 shows 
that the difference of f, and f5, fo, fig except the dimensionality is the type of inequality constraints in the 
problem. f, has only linear constraints, unlike f7, fo and f;9 which have nonlinear constraints. The algorithm 
tends to have difficulty in solving the optimization problems with equality constraint(s) (f3, fs and f,3), 
except 1. In f,1, the proposed algorithm consistently approaches the optimal solution when n = 10 and 25. 
Table 1 shows that the difference of f,, and the others is it is low dimensional and has only one equality 
constraint. Moreover, the algorithm tends to find difficulty in solving the high dimensional optimization 
problems with nonlinear inequality constraints only (f, f>, fo and f,o). 

When the proposed algorithm is evaluated on f;, f7, f. and fg with a big population size, e.g. n = 
2000, and the same termination criterion, the obtained solutions are much better and the standard deviations 
are much smaller even though the computational time limit is same, e.g. 600 seconds (Table 5). When the 
time limit is longer, i.e. 1200 seconds, Table 5 shows that LaF does not obtain better solutions, except on fp. 
Thus, in solving the optimization problems with high dimensional optimization problems with nonlinear 
inequality constraints only, LaF requires a big population size (n = 2000). 


Table 5. The Results Obtained by the Proposed Algorithm for High Dimensional Optimization Problems with 
inequality constraints only (fy, fz, fo and f,9) when n = 2,000 











Time Limit 600s 1200s 

Problem he fr fo fo he fr fo fio 
Best -0.8035 24.3114 680.6303 7.14E+03 -0.8036 24.3085 680.6303 7.09E+03 
Mean -0.8035 24.3168 680.6305 7.19E+03 -0.8036 24.3199 680.6305 7.ATE+03 
Worst -0.8034 24.3349 680.6308 7.24E+03 -0.8036 24.3597 680.6311 7.29E+03 
Std 2.8E-05 0.0067 1.88E-04 33.7939 5.5E-06 0.0154 2.34E-04 69.3378 





Table 6 presents the comparison of solutions obtained by the proposed algorithm and other 
metaheuristics, i.e. Harmony Search with two stage penalty function (HS) [13], Firefly Algorithm with 
combination of static penalty and feasibility rules (FA) [14], Cohort Intelligence (CI) with static penalty 
(SCI) and dynamic penalty (DCD) [16], Differential Search with static penalty (SDS) and dynamic penalty 
(DDS) [17] and Musical Composition Method (MCM) [18]. The proposed algorithm obtains the smallest 
values of best, mean, worst and standard deviation values in this comparison on f;, fs, fa, f6. fo and fio. 
It means that LaF is better and more consistent or stable than the other metaheuristics in solving these 
problems. In the other problems (f5, fs, f7, fo and fi3), except fg and f,,, LaF is still not competitive 
compared to the other metaheuristics, since it has difficulties in solving high dimensional optimization 
problem with non-linear constraints and any problem which has more than one equality constraint. In fg and 
fi1, LaF obtains the known optimal solutions, but SDS on fg, FA and MCM on f,, apparently obtain better 
solutions than the optimal solutions that have been known so far. However, in overall, LaF is more 
competitive than the other metaheuristics. 


5. CONCLUSION 

Based on the result and analysis, it is concluded that Leaders and Followers (LaF) algorithm can be 
implemented to solve constrained non-linear optimization problems. With small population size, i.e. n <10, 
LaF consistently and successfully find the optimal solution of low dimensional (s <5) optimization 
problems with inequality constraints only and the low dimensional (s < 2) problem with only one equality 
constraint. With population size, 1.e. 2 2100, LaF can optimally solve any high dimensional constrained non- 
linear optimization problem that has high number of linear inequality constraints and no non-linear 
constraint. LaF has difficulty in solving high dimensional optimization problem with non-linear constraints 
and any problem which has more than one equality constraint. 

In the comparison with other metaheuristics, LaF has better performance in overall benchmark 
problems. It should also be noted that the constraint-handling method used in the proposed algorithm is only 
the classical static penalty function and the LaF algorithm used in this study is the original one. It means that 
there is a big possibility to use some better constraint-handling method or to modify the original LaF 
algorithm in order to obtain much better performance in the further studies. 
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Table 6. Comparison of Solutions Obtained by the Proposed Algorithm and other Metaheuristics 



























































LaF HS [13] FA [14] SCI [16] DCI [16] SDS [17] _DDS [17] MCM [18] 

Best -15 -14.999 NA -14.997 -15 -15 -15 -15 
Mean -15 -14.959 NA NA -14.9 -14.8 -12.3 NA 

fi Worst -15 -14.893 NA NA -13 -6 -13 NA 
Std 7.25E-16 0.0229 NA 0.1982 4.5E-01 2.5567 0.0181 0.1473 
Best -0.8036 -0.7255 NA -0.8036 -0.8036 -0.8036 -0.8035 -0.8036 
Mean -0.7897 -0.7009 NA NA -0.7864 -0.7920 -0.7880 NA 

fr Worst -0.7692 -0.6543 NA NA -0.7395 -0.7729 -0.7743 NA 
Std 0.009 0.0397 NA 0.0361 0.02 0.0009 0.0007 0.0253 
Best -1.0002 - 1.0000 NA -1.0013 -0.9999 NA NA _ -0.9997 
Mean -1.0002 -0.988 NA NA -0.9839 NA NA NA 

fs Worst -1.0002 -0.951 NA NA -0.7395 NA NA NA 
Std 2.00E-06 0.0137 NA 0.0011 5.0E-02 NA NA 0.0008 
Best -30666 -30665 -30665 -30666 -30665 -30666 -30666 -30666 
Mean -30666 -30582 -30665 NA -30665 -30662 -30666 NA 

fa Worst -30666 -30405 -30664 NA -30665 -30599 -30666 NA 
Std 6.00E-12 24.2567 0.4755 0.045 4.9E-03 1.4968 0.1204 16.175 
Best 5128.6 5112.3 NA 5119.1 4232.6 5131.3 5131.3 5121.2 
Mean 5253.1 5115.2 NA NA 4896.6 5557.3 5745.1 NA 

fs Worst 5673.6 5125.3 NA NA 5612.5 6112.2 6112.2 NA 
Std 164.81 1.25 NA 40.42 3.9E+02 43.56 40.64 42.19 
Best -6961.8 -6961.6 -6960.5 -6961.8 -6961.8 -6961.8 -6961.8 -6961.8 
Mean -6961.8 -6961.3 -6956.6 NA -6961.8  5.9E+13 1.8E+6 NA 

Ts Worst -6961.8 -6960.9 -6953.5 NA -6961.8  2.4E+15 3.6E+7 NA 
Std 0 0.2443 2.1928 1.5E-05 0 1.1E+14 8.1E+6 —3.8E-07 
Best 24.3084 24.552 24.3805 24.3044 24.3281 24.3302 24.315 24.3506 
Mean 24.4549 27.612 24.4705 NA 24.4677 24.341 = 24.7153 NA 

fr Worst 24.8242 31.231 24.6024 NA 24.987 25.5169 25.5336 NA 
Std 0.1303 1.6545 0.0597 0.2216 0.18 0.0382 0.0306 0.2135 
Best -0.0958 -0.0958 -0.0958 -0.0958 -0.0958 -0.0959 -0.0958 -0.0958 
Mean -0.0958 -0.0807 -0.0958 NA -0.0958 -0.0959 -0.0958 NA 

fe Worst -0.0958 -0.0761 -0.0958 NA -0.0958 -0.0959 -0.0958 NA 
Std 4.01E-18 0.0136 2.88E-06 -1L.1E-12  2.1E-12 0 0 6.2E-08 
Best 680.6301 680.656 680.8463 680.6726 684.1806 680.63 680.63 680.6738 
Mean 680.6307 680.742 681.0415 NA 684.1996 680.7093 680.7132 NA 

fs Worst 680.6321 680.779 681.2603 NA 684.2519 680.9682 681.1324 NA 
Std 4.59E-04 0.0725, 0.15336 0.2598  1.66E-02 0.0082 0.0011 0.2882 
Best 7081.5 7082.6 NA 7051.8 8648.2 7058.19 7056.76 7051.9 
Mean 7239.8 7110.2 NA NA 9286.5 7297.595 7350.35 NA 

fro Worst 7469 7110.3 NA NA 11745.2 7621.005 7846.79 NA 
Std 111.7 2.0854 NA 11.5586 8.6E+02 16.581 20.042 15.3881 
Best 0.7499 0.749 0.7490 0.7497 0.7501 -0.7499 -0.7499 0.7489 
Mean 0.7499 0.749 0.7490 NA 0.7798 -0.8457 -0.7731 NA 

fia Worst 0.7499 0.749 0.7490 NA 0.8801 -1 -1 NA 
Std 6.50E-08 3.0E-06 —_3.42E-06 0.0013 3.5E-02 0.0116 0.006 0.0011 
Best -1 -0.9909 — -0.99995 -1 -1 -1 -1 -1 
Mean -1 -0.9525 -0.99995 NA -1 -1 -1 NA 

fa Worst -1 -0.8913 -0.99995 NA -1 -1 -1 NA 
Std 0 0.0888 _7.78E-07 1.6E-12 1.4E-09 0 0 0.0025 
Best 0.1789 0.0571 NA NA NA NA NA NA 
Mean 1.0785 0.0595 NA NA NA NA NA NA 

fis Worst 4.9511 0.0703 NA NA NA NA NA NA 
Std 1.5194 0.0726 NA NA NA NA NA NA 











NA = Not Available 
Std = Standard Deviation 
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